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ABSTRACT 


Consider  Che  three-factor  crossed  classification  component s-of- 

variance  model  with  interaction  given  by 

Y. _  ■  u  +  A  +  B.  +  F  +  C.  +  G.,  +  H..  +  P  ,,  +  • 

ijkm  i  j  ij  k  ik  jk  ijk  ijkm 


In  this  paper  approximate  confidence  intervals  are  exhibited  and  evalu¬ 
ated  for  the  variances  a*,  o|,  a£.  A-lso  a  test  of  H^:  o*  ■  0  vs. 

H  s  o?  >  0  is  given  and  evaluated, 
a  a 
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1.  Introduction 

/—The  problem  discussed  in  this  paper  is  that  of  setting  confidence 
limits  on  the  variance  components  in  the  three-factor  crossed  components- 

of-variance  model  with  interaction.  The  model,  described  in  detail  in  Sec. 

Ss- 

15.5.3  of  Graybill  (1976),  is  given  by 

Tu»»  - » +  Ai  +  +  V  ♦  pljk  ♦  *ljkm 

i  "  !•  2*  •••$  I  >  1>  j  *  1>  2,  ••••  J  >  lj  k  ■  1,  2f  •••!  K  >  1; 

®  *  If  2f  »M|  H  ^  1« 

E(Aa)  -  E^)  -  E(F±J)  -  E(Ck)  -  E(Gik)  -  E(Hjfc)  «  E(P±jk) 

"  E<Cijkm)  "  °* 


Var(A±)  -  a*.  Var(Bj)  -  or*.  VarCF^)  -  oj,  Var(Cfc)  -  a£, 

v*r(0ik>  ■  °g*  V«<V  ■  «|.  v*'(p1Jk)  ■  v“(eijta)  •  »!• 

Ih,  random  variable.  Bj.  Fy  Ck,  0^.  HJk>  Fyk  and  rljkm 

ar«  independent  and  jointly  normally  distributed. 

An  analysis  of  variance  (ANOVA)  for  this  model  is  displayed  in 

Table  1. 


The  following  results  for  this  model  are  given  in  Graybill  (1976)  . 

(a)  Y. ...»  S*,  S*.  ....  Sg  are  complete  sufficient  (and  hence 
minimal  sufficient)  statistics  for  this  problem. 

(b)  Y....,  S*,  S*,  .....  S*  are  jointly  independent. 

(c)  U±  «  S*/y*  .  n^(MSi)/Y*  is  distributed  as  a  central 
chi-square  random  variable  with  n^  degrees  of  freedom  for 
i  -  1,  2,  ....  8. 

8  8 

M)  l  C. (MSI)  is  the  UMVU  estimator  for  I  C.  y?  for  any  sec  of 
1-1  1  1-1  1  1 
constants  C^t  • • • • 
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The  problem  discussed  In  this  paper  is  chat  of  obtaining  confidence 
intervals  for  the  variance  components  a*,  o^,  o£,  a*,  a*;,  a2f  a2f  and  0 2. 

Variance  component  models  are  quite  important  and  useful  for  many 
applied  problems.  Duncan  (197U)  gives  an  example  where  this  model  can  be  used. 

Three  analysts  each  made  a  determination  of  the  melting  point  of  hydroquinone  on  each 
of  two  days  with  four  different  thermometers.  The  model  is  a  three-way  crossed 
random  effect  model  when  the  analysts  are  selected  at  random  from  a  population 
of  analysts,  the  thermometers  are  selected  at  random  from  a  population  of 
thermometers,  and  the  days  are  considered  a  random  selection  from  a  population 
of  days.  It  may  be  important  to  determine  the  variance  of  the  analysts  or  of 
the  thermometers.  Scheffe  (1959)  also  describes  a  situation  when  this  model  is 
appropriate.  The  three  factors  are  machines,  workers,  and  batches  of  material. 

One  point  of  Interest  is  to  determine  the  variance  of  the  machines  or  of  the 
workers . 

The  only  variance  component  of  those  listed  above  for  which  an  exact  con¬ 
fidence  interval  exists  is  a*.  In  this  paper  an  exact  (approximate)  con¬ 
fidence  interval  means  a  confidence  interval  whose  confidence  coefficient 
is  equal  (approximately  equal)  to  a  specified  value  1  -  a.  Moriguti  (195U) 
gives  a  procedure  that  can  be  used  for  "good"  approximate  confidence 
intervals  for  cj£,  a£,  a^,  and  Op-  This  procedure  was  also  discussed  by 
Bulmer  (1957),  Moriguti' s  procedure  applies  to  the  following  setup: 

1)  Let  *  niVi/9i  ^or  *  **  1*  2,  be  independent  chi-square 
random  variables  with  n^  degrees  of  freedom. 

2)  Let  ej  -  ©2  +  0  ;  i.e.,  0*  -  e2  .  e  *  o. 

3)  If  F  is  the  upper  o  probability  point  of  Snedecor's  F  dis- 

(s«  n^t 

tribution  with  n^  degrees  of  freedom  in  the  numerator  and  degrees 
of  freedom  in  the  denominator,  then  an  approximate  1  -  a  upper  confi¬ 
dence  Interval  on  6  is 
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(1.1) 


K  <  6  <  °°  where 
a  — 


a:  nlt  • 


_  V,  +  F  .  n  _  at  ”l‘  \  _2 

2  ot  •  n f  ii—  (1  “  .  )  it 

1  2  <*:  nv  -  V1 


(1.2) 


An  approximate  1  -  a  lower  confidence  interval  on  8  is  0  ^  8 

where  Kj_  Q  is  obtained  from  (1.2)by  substituting  1  -  o  tor  o  throughout. 

By  substituting  the  appropriate  MSi,  MSj,  y*,  Yj  from  Table  1  for  V^,  V^, 

8*,  and  8^  respectively  one  can  obtain  upper  and  lower  confidence  intervals 

for  Y~  -y,  *  MK  o£  and  hence  confidence  intervals  for  o|.  Confidence  inter- 

vals  for  <s£,  ciu«  and  o|  can  be  obtained  similarly  as  the  difference  of  the 
u  n  r 

appropriate  Y^  and  y^.  The  excellence  of  this  procedure  is  exhibited  in 
Bulmer  (1957);  also  see  Scheffd  (1959).  Howe  (197*0  gives  another  method  for 
obtaining  confidence  intervals  for  8*  0^  -8*  when  0  >0  but  for  the  problem 
discussed  in  this  paper  we  prefer  (1.1).  None  of  the  methods  above  gives 
a  confidence  interval  for  o£,  o£,  or  o£.  Satterthwaite  (19U6)  and  Welch  (1956) 
proposed  general  procedures  for  setting  approximate  1  -  a  confidence  in¬ 
tervals  on^C^Y^.  a  linear  combination  of  variances*  This  procedure  is 
useful  in  certain  situations  (such  as  when  the  are  non-negative), 
but  the  method  is  not  recommended  when  some  of  the  are  negative. 

Since  MJK  0*  -  Y1  '  Y3  *  Y5  +  Y7’  these  Procedures  are  not 
recommended  for  setting  confidence  limits  on  oj*  .  In  fact,  no  "good" 
method  for  obtaining  approximate  1  -  a  confidence  intervals  on  0*  has 
appeared  in  the  literature. 

In  section  2  formulas  are  given  for  approximate  upper  and  lower 
confidence  intervals  on  oj*  and  the  approximation  is  evaluated.  Clearly 
confidence  intervals  on  Og  and  0*  can  be  obtained  from  the  formulas  for 
o*  by  substituting  the  appropriate  MSi,  y^>  and  I,  J,  K,  M;  also  two-sided 
approximate  confidence  Intervals  can  be  obtained  from  the  upper  and  lower 
confidence  Intervals.  Section  3  contains  a  discussion  of  how  the  formulas  in 
section  2  were  obtained,  and  a  summary  of  the  results  are  given  in  section  4. 


> 


w 


2.  Qpper  and  Lower  Confidence  Intervals  on  <jj^. 

The  upper  approximate  1  -  a  confidence  interval  on  a2  is  L  <  c*  <  • 

A  A 


where  L  is  given  by 


L  -  (MJK) 


-1 


MSI 


a:  n 


1* 


-  MSS  +  F  „  (1  -  /'  °1'  (if>: 

15  a:  n.,  • 


(2.1) 


- ms3  +  f  a  - y — (~2  +  i  a  +  f 

a*  n,  f  n*  r  MSI  •  tt«  n-i 

1  j  a:  n^i  •  2  / 


)MS7 


If  L  Is  negative  It  Is  replaced  by  zero. 

i 

The  lower  approximate  1  -  a  confidence  Interval  on  aj  is  0  i  x  D 
where  U  is  given  by 


0  -  (MJK) 


-1 


MSI 


_ MSS  +  v  a  -  1-°;  V  p5  (MS5)2 

Wn.  -  V”i  Fl-:  a1.  -  MS1 


-  MS3 


v  v 
l  j  i-o :  n^t  ®  L  / 


)MS7 


(2.2) 


If  U  is  negative  it  is  replaced  by  zero. 

L  <a^<  U  is  a  two-sided  approximate  1  -  a  confidence  interval  on  when  a 
is  replaced  throughout  with  a/2. 

To  evaluate  the  performances  of  the  upper  and  lower  confidence  intervals 
given  above,  a  simulation  study  was  conducted.  We  describe  only  the  upper 
confidence  interval  L  <_  o*  <  «  where  L  is  given  by  (2.1).  This  interval  can 
be  written  as 


MSI  «(*£!’  MST  2  „  v2  .  v2  +  v2  <  „ 

glMSl  MSI  MSI5  S  Y1  y3  v5  +  Y7 


Ineouality  (2.3)  can  be  rewritten 

i ,  (yh% 

nl  V^in3  Yi^in5  Yl^ln7 


<  1 


(2.3) 
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where  MSi/y2  are  Independent  chi-square  random  variables  with  n^  degrees 

of  freedom  for  i  »  1,  3,  5,  7.  Therefore  a  set  of  unknown  parameters  for  this 
problem  is  given  by 


A  one-to-one  function  of  the  set  of  unknown  parameters  given  by  (2.4)  is 

Mo ^  Mo?  Mo* 

8P  “  - >  9C  “  - »  9 »  *  -  • 

c2  +  Mo2  o2  +  Mo2  o2  +  Mo2 

e  p  e  p  e  p 

In  the  simulation  study  to  be  described  next  we  fixed  y^  to  be  equal  to 
one,  since  the  probabilities  involved  are  invariant  under  a  change  of  scale  in 
the  y^'s,  considered  0^.,  0^  and  0^  as  the  unknown  parameters.  Each  of  these 

parameters  is  allowed  to  take  values  from  the  set 

{0.0,  0.01,  0.1,  1.0,  10.0,  100.0},  (2. 
giving  altogether  a  combination  of  216  (6x6x6)  distinct  values.  Also  six 
set  of  (IJK)  values,  shown  in  Table  2,  were  investigated.  The  first  step  of 
the  simulation  was  to  choose  values  for  I,  J,  K  and  a  in  the  model,  then  the 
values  for  the  degrees  of  freedom,  n^,  n^>  n^  and  can  be  readily  computed 
using  formulas  in  Table  1. 

A  set  of  chi-square  random  variables  with  respective  degrees  of 

freedom  n^,  (i  »  1,  3,  5,  7)  was  generated  using  IMSL  program  package  routine 
GGCSS  in  CDC  6400  system.  Of  the  216  different  values  for  the  set  of 
parameters  (Sp,  9G,  0A>,  one  was  chosen  and  y2(i  -  1,  3,  5,  7)  and  the 

parameter  of  interest  o2  -  (y2  -  y2  -  y2  +y2)/(MJK)  were  calculated.  To  obtain 

the  values  of  the  mean  squares,  the  obviou3  transformation  MSi  *  ylV^/n^  was 
used.  At  this  point  all  the  different  values  necessary  to  calculate  the  confi¬ 
dence  point  were  at  hand.  The  procedure  was  repeated  5000  times  and  the  per¬ 
centage  of  times  the  confidence  interval  contained  the  parameter  c2  was  calculated 


for  each  confidence  level.  The  calculations  were  repeated  with  the  other  215  values 


for  the  set  of  parameters  and  the  same  set  of  random  numbers.  The  entire 
procedure  was  then  repeated  for  different  values  of  (I,  J,  K).  The  results 
are  given  in  Table  2.  A  simulation  study  was  then  conducted  for  the  lower 
confidence  interval  on  oj*  by  repeating  the  above  procedure  with  the  upper 
confidence  point  U  in  (2.2).  These  results  are  displayed  in  Table  3.  To 
demonstrate  that  Satterthwaite ' s  method  is  not  satisfactory  for  this  problem, 
a  simulation  was  conducted  for  that  method  for  1  -  a.  =  .95*  These  results  are 
in  Table  2. 


In  this  section  we  describe  how  the  confidence  points  for  oj"  given  by 
(2.1)  and  (2.2)  are  obtained.  We  discuss  only  the  lower  confidence  point  L. 

The  problem  is  to  determine  a  function  q*(Ymi,  YIJRM)  such  that 

Y1112’  **•*  YijiqP  -  a\  <  is  approximately  (and  close  to)  a 
specified  value  1  -  a.  The  statistics  Y....,  MSI,  MS2,  ....  MS8  are  suffi¬ 
cient,  complete  (and  hence  minimal)  statistics  for  this  problem  so  we 
restrict  attention  to  a  function  of  these  for  the  confidence  limits;  i.e., 

we  determine  a  function  q(Y....,  MSI,  MS2 . MS8)  such  that 

P[q(Y....,  MSI,  MS2,  ...,  MS8)  <  <  •]  is  approximately  equal  to  a  specified 

value  1  -  a. We  want  the  confidence  interval  to  be  unchanged  if  a  constant  is  added 
to  each  observation  Y^^.  If  this  constant  is  the  negative  of  the  value  of 

then  MSI,  MS2,  ....  MS8are  unchanged  and  q(Y. ...,  MSI,  MS2,  . MSS) 

becomes  q(0,  MSI,  MS2,  ....  MS8).  Hence,  it  is  sufficient  to  look 

for  a  function  of  MSI,  MS2,  ...,  MS8  only  for  a  lower  confidence  point  for 
The  problem  can  now  be  reformulated  as  follows:  Given  the  jointly 
independent  random  variables  Ui  *  n^MSi/y^  for  i  *  1,  2,  ...,  8  where  Ui 
is  a  chi-square  random  variable  with  n^  degrees  of  freedom,  we  want  an 
approximate  upper  1  -  a  confidence  interval  on  =  (y?  -  y?  -  y?  +  y?)/MJK 
or  equivalently  on  MJK  o^  ■  y^  -  y|  -  y|  +  y*.  Intuition  says  that  it  is 
sufficient  to  examine  only  functions  of  MSI,  MS3,  MSS,  and  MS 7  for  confi¬ 
dence  limits  on  MJK  c^.  The  fact  that  these  statistics  are  inference 
sufficient  for  y^,  y^,  y^,  y^  in  the  reformulated  problem  gives  justi¬ 

fication  for  this  reasoning.  For  a  discussion  of  inference  sufficiency 
see  Fraser  (1956)  and  Rao  (1965).  The  problem  now  takes  the  reduced  form: 
Determine  a  function  f(MSl,  MS3,  MS5,  MS7) 


•uch  that  P[f (MSI,  MS3,  MS5,  MS7)  -  Y^  -  Y3  “  y|  +  Yy]  is  approximately 

equal  to  the  specified  1  -  a.  Now  suppose  all  observations  are 

multiplied  by  a  non-zero  constant  c.  Then  MSI,  MS3,  MSS,  and  MS7  are 
2 

multiplied  by  c  and  also  the  uniformly  minimum  variance  unbiased  esti- 

2 

mator  of  is  multiplied  by  c  .  We  thus  impose  the  condition  that  the 

2 

lower  confidence  point  should  be  multiplied  by  c  which  implies 

f(c2  MSI,  c2  MS3,  c2  MS5,  c2  MS7)  ■=  c2f(MSl,  MS3,  MSS,  MS7) .  If  we  let 

c2  «  1/MSI  we  obtain  f(MSl,  MS3,  MS5,  MS7)  -  MSI  f(l,  F3,  F5,  F7)  » 

MSI  g(F3,  F5,  F7)  where  Fi  *  MSi/MSl,  i  -  3,  5,  7.  So  we  must  determine  the 
function  g(F3,  F5,  F7)  such  that 

P[MS1  g(F3,  F5,  F7)  <  JKM  a\ ] 

is  approximately  equal  to  the  specified  1  -  a. 

Conditions  (1),  (2),  (3)  below  seem  intuitively  desirable  to  impose  on  g(F3,  F5.F7) 
(l)  The  confidence  interval  is  required  to  reduce  to  the  one  given  by  (l.l) 

when  =  y2  _  o  and  p5  =  F?  =  q.  (Note  that  F5  =  F7  =  0  with  probability 
one  when  *  Yy  *  0.)  When  Y^  =  Yy  =  0  the  parameter  of  interest, 

JKM  =  Y2  “  y|  -  Y5  ♦  Yy,  becomes  y*  -  y2  so  replace  V1  by  MSI, 

V2  by  MS3,  and  n2  by  n^  in  (1.2)  and  obtain 


MSI 


-  MS3  +  F 


a:  n 


1’  n3 


<1  - 


n3v (MS3)2 
,  '  MSI 


This  implies  (since  y|  -  y*  «  0  implies  F5  »  F7  -  0  with  probabilicy  one) 
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MSI  g(F3,  0,  0) 


MSI 


F 


-  MS3  +  F 


a:  n^  • 


os  n1§  n3 


(MS3)2 

MSI 


(1  - 


F 

a:  n^. 


Fo:  n^» 


(2)  The  confidence  interval  must  be  symmetric  in  MS3  and  MS5.  This 
condition  is  imposed  because  of  the  obvious  symmetry  in  the 

model. 

(3)  The  confidence  interval  must  converge  to  (1.1)  when 
K  ,  and  when  J  -*■  ». 

A  natural  class  of  functions  that  suggests  itself  for 
g(F3,  F5,  F7)  is  polynomials  in  F3,  F5,  and  F7.  A  first  approximation 
is  a  linear  function  of  the  form 

g(F3,  F5,  F7)  =■  bQ  +  b^  +  b2F5  +  b3F7. 


This  form  of  function  is  immediately  rejected,  because  condicion  (1) 
and  condition  (2)  on  g(F3,  F5,  F7)  require  that  squared  terms  in  F3  and 
F5  be  included.  When  this  is  done  the  function  g(F3,  F5,  F7)  takes  the 
form 


g(F3,  F5,  F7)  -  aQ  +  3^3  +  a2F5  +  a3F7  +  a4(F3)2  +  a5(F5)2 


where  a^,  a^,  a2>  a3>  a^,  and  a^  are  constants  to  be  determined  so  that 
conditions  (1)  to  (3)  are  satisfied. 

Condition  (1)  gives 


a^  “  -1  and  a 


Then  condition  (2)  gives 

a„  ■  -1  and  a, 
2  3 


Conditions  (1),  (2)  and  (3)  impose  the  following  limiting  conditions  on  a y 

1  as  J  *  •;  a3  +  1  as  K  +  ». 
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There  is  more  than  one  constant  a^  which  will  satisfy  the  restriction 


a-  1.  The  following  four  values  for  a  were  chosen  to  be  examined. 
J  1 


(a) 

a3  " 

1 

(b) 

a3  * 

F 

&:  n^,® 

(c) 

a3  = 

1/F 

a:  n7,® 

(d) 

a3  = 

(1  +  F  )/2 

a:  n 

A  preliminary  simulation  study  indicated  that  a_  =  (1  +  F  )/2 

3  a:  n^,  “ 

gives  better  confidence  limits  than  the  other  three.  Thus  the  final  1-a 
lower  confidence  point  L  is  given  by  (2.1).  Since  is  known  to  be  non- 
negative,  if  any  confidence  point  is  negative  it  is  replaced  by  zero.  The 
confidence  point  given  by  (2.1)  satisfies  conditions  other  than  those  given 


above.  They  are  as  follows: 

(4)  The  confidence  coefficient  1  -  a  when  -*  <*>. 

A 

(5)  The  confidence  coefficient  -*•  1  -  a  when  J  K  ®. 

(6)  The  confidence  point  "coincides"  with  the  parameter  as  I  +  ». 


I  implies  that  n^  -»■  «®  for  i  =  1,  3,  5,  7;  i.e., 

sample  sizes  for  all  random  variables  involved  tend  to  infinity. 

In  this  limiting  case  MSi  converges  in  probability  to  y^  for  i  = 

1,  3,  5,  7,  and  it  is  easily  seen  that  the  confidence  limit  given 
by  (2.1)  converges  in  probability  to  y^  -  y^  -  yjj  +  Y^  =  M7K  a^. 

(7)  If  o'-,  is  large  relative  to  the  other  o2s,  then  MJK  =  y^  -  y^  -  y^  + 

y ^  is  dominated  by  y^  -  y^  and  S*,  tend  to  be  large  relative  to  S^, 

2  2  2  2  2  2 
S^.  Thus  when  S^,  are  small  relative  to  S^,  (actually  when  S,.  - 

2 

*  0)  the  confidence  limit  (2.1)  reduces  to  (1.2),  a  lower  confidence 
limit  on  y*  -  y*. 

(8)  A  result  similar  to  (7)  applies  when  o£  is  large. 
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4.  Summary  and  Conclusions. 


By  examining  Tables  2  and  3  it  is  quite  clear  that  the  lower  and 
upper  confidence  points  given  by  (2.1)  and  (2.2)  result  in  confidence 
coefficients  that  are  quite  close  to  the  specified  confidence  coefficients 
even  for  small  values  of  I,  J,  and  K.  Thus  this  procedure  can  be  re¬ 
commended  for  confidence  intervals  on  a* ,  and  ffj;  for  the  random 

3-factor  crossed  classification  model  with  interaction. 

The  problem  of  testing  the  hypothesis  H,:  =*  0  vs.  H  :  >0  in  a 

three  factor  model  with  interaction  has  been  discussed  by  Duncan  (1974)  and 
Jeyaratnam  (1978).  The  lower  1  -  a  confidence  point  L  for 
given  in  (2.1)  can  be  used  as  a  test  statistic  for  a  test  of  size  a  of  Hq 
vs.  H  .  The  hypothesis  Hn  is  rejected  if  and  only  if  the  computed  value 
of  the  test  statistic  is  positive.  For  a  =  .05  and  a  **  .10  the  simula¬ 
tion  study  described  earlier  included  a  tabulation  of  the  proportion  of 
times  that  L  is  positive  (i.e,  that  Hq  is  rejected)  when  *  0  for  values 

of  the  parameters  0  and  0_  given  in  (2.6).  This  is  the  probability  of  a 
r  b 

Type  I  error  and  should  be  close  to  a  *  .05  and  a  ■  .10  respectively.  The 
results,  given  in  Table  4,  show  that  the  method  gives  values  very  close  to 
the  specified  probability  of  a  Type  I  error. 


-li¬ 


ft- 


Table 


entries  in  the  table  give  the  range  of  confidence  coefficients  obtained  by  simulation 


on 


Simulation  -Probabilities  of  a  Type  I  Error  for  Testing 
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ABSTRACT 


Consider  the  three-factor  crossed  classification  components- 

of-variance  model  with  interaction  given  by 

Y .  =  p  +  A.  +  B.  +  F.  .  +  C  +  G.,  +  H  +  P.„  +  e.  . 

ljkm  i  ■!  1.1  k  lk  jk  ljk  ijkm 

In  this  paper  approximate  confidence  intervals  are  exhibited  and 

evaluated  for  the  variances  o^,  o^,  a£.  Also  a  test  of  H. :  cr?  -  0 

ABC  0  a 

vs.  H  :  Oj  >  0  is  given  and  evaluated. 

&  A 


